o
r in
v
e
sting.
R
EFERE
N
CES
¨
[
1
]
K. Mis
he
v
, A.
G
j
o
rg
j
e
v
i
k
j
, I. V
oden
s
k
a
, L. T. C
h
i
t
k
u
s
he
v
,
and
D
. Tr
a
-
j
ano
v
, “E
v
a
l
ua
t
i
on
o
f
s
en
t
im
en
t
ana
l
y
sis i
n
f
i
nan
c
e
: Fr
o
m l
e
x
ic
on
s
t
o
t
r
an
s
f
o
rm
e
rs,” IEEE Acc
e
ss,
v
o
l. 8,
pp
. 131662–131682, 07 2020.
[
2
]
H
. T
ou
v
r
on
, L. M
a
r
t
i
n
, K. S
t
one
,
P
. Al
be
r
t
, A. Alm
aha
iri, Y. B
abae
i,
N
. B
a
s
h
l
yk
o
v
, S. B
a
t
r
a
,
P
. B
ha
rg
a
v
a
, S. B
ho
s
a
l
e
e
t
al., “Ll
a
m
a
2:
O
pen
f
ounda
t
i
on
and
f
i
ne
-
t
uned
c
ha
t
m
ode
ls,” a
r
X
iv
p
r
ep
r
i
n
t
a
r
X
iv:2307.09288, 2023.
[
3
]
E. J.
H
u
, Y. S
hen
,
P
. W
a
llis, Z. All
en
-
Z
hu
, Y. Li, S. W
an
g, L. W
an
g,
and
W. C
hen
, “L
o
RA: L
o
w
-
r
an
k
adap
t
a
t
i
on
o
f
l
a
rg
e
l
an
g
ua
g
e
m
ode
ls,” a
r
X
iv
p
r
ep
r
i
n
t
a
r
X
iv:2106.09685, 2021.
[
4
]
E. F. F
a
m
a
, “E
f
f
ici
en
t
c
ap
i
t
a
l m
a
r
k
e
t
s: A r
e
v
i
e
w
o
f
t
heo
r
y
and
e
m
p
iric
a
l
w
o
r
k
,”
T
he
J
ou
r
n
al
of
Fi
n
a
n
c
e
,
v
o
l. 25,
no
. 2,
pp
. 383–417, 1970.
[
5
]
X. Li,
H
. Xi
e
, L. C
hen
, J. W
an
g,
and
X.
D
en
g, “
N
e
ws im
pa
c
t
on
s
t
o
c
k
p
ric
e
r
e
t
u
r
n
v
i
a
s
en
t
im
en
t
ana
l
y
sis,” K
now
l
ed
g
e
-B
as
ed
S
ys
t
em
s,
v
o
l. 69,
pp
. 14–23, 2014.
[
6
]
Z. T. K
e
, B. T. K
e
ll
y
,
and
D
. Xi
u
, “
P
r
ed
ic
t
i
n
g r
e
t
u
r
n
s wi
t
h
t
e
x
t
da
t
a
,”
N
a
t
i
ona
l B
u
r
eau
o
f
Ec
ono
mic R
e
s
ea
rc
h
, T
e
c
h
. R
ep
., 2019.
[
7
]
N
. Cris
t
i
an
i
n
i
and
J. S
ha
w
e
-
T
a
y
l
o
r, A
n
i
n
t
r
odu
c
t
i
on
t
o
s
uppo
r
t
v
e
c
t
o
r
m
ac
h
i
ne
s a
nd
o
t
he
r
k
e
r
ne
l
-
b
as
ed
l
e
a
r
n
i
n
g
me
t
hod
s. C
a
m
b
ri
d
g
e
U
n
i
-
v
e
rsi
t
y
P
r
e
ss, 2000.
[
8
]
Z. Y
an
g,
D
. Y
an
g, C.
D
y
e
r, X.
H
e
, A. Sm
o
l
a
,
and
E.
H
o
vy
, “
H
i
e
r
a
rc
h
ic
a
l
a
tt
en
t
i
on
ne
t
w
o
r
k
s
f
o
r
do
c
u
m
en
t
cl
a
ssi
f
ic
a
t
i
on
,” 01 2016,
pp
. 1480–1489.
[
9
]
J.
D
e
v
li
n
, M.
-
W. C
han
g, K. L
ee
,
and
K. T
ou
t
ano
v
a
, “BERT:
P
r
e
-
t
r
a
i
n
i
n
g
o
f
deep
b
i
d
ir
e
c
t
i
ona
l
t
r
an
s
f
o
rm
e
rs
f
o
r l
an
g
ua
g
e
unde
rs
t
and
i
n
g,” i
n
N
o
r
t
h
A
me
r
ica
n
C
h
a
p
t
e
r
of
t
he
Ass
o
cia
t
i
on
fo
r
C
ompu
t
a
t
i
on
al Li
n
g
u
is
t
ics,
2019.
[O
n
li
ne
]
. A
v
a
il
ab
l
e
:
[
10
]
D
. Ar
a
ci, “Fi
n
BERT: Fi
nan
ci
a
l s
en
t
im
en
t
ana
l
y
sis wi
t
h
p
r
e
-
t
r
a
i
ned
l
an
g
ua
g
e
m
ode
ls,” a
r
X
iv
p
r
ep
r
i
n
t
a
r
X
iv:1908.10063, 2019.
[
11
]
Z. C
hen
, S.
G
o
ssi, W. Kim, B. B
e
rm
e
i
t
i
n
g
e
r,
and
S.
H
and
sc
huh
,
“Fi
n
BERT
-
F
O
MC: Fi
ne
-
t
uned
Fi
n
BERT M
ode
l wi
t
h
s
en
t
im
en
t
f
o
c
u
s
m
e
t
hod
f
o
r
enhan
ci
n
g s
en
t
im
en
t
ana
l
y
sis
o
f
F
O
MC mi
nu
t
e
s.”
P
r
o
-
c
eed
i
n
gs
o
f
t
he
4
t
h
ACM I
n
t
e
r
na
t
i
ona
l C
on
f
e
r
en
c
e
on
AI i
n
Fi
nan
c
e
,
2023,
pp
. 357–364.
[
12
]
X.
-
Y. Li
u
,
G
. W
an
g,
and
D
. Z
ha
, “Fi
n
GP
T:
D
e
m
o
cr
a
t
i
z
i
n
g i
n
t
e
r
ne
t
-
sc
a
l
e
da
t
a
f
o
r
f
i
nan
ci
a
l l
a
rg
e
l
an
g
ua
g
e
m
ode
ls,” a
r
X
iv
p
r
ep
r
i
n
t
a
r
X
iv:2307.10485, 2023.
[
13
]
H
. Y
an
g, X.
-
Y. Li
u
,
and
C.
D
. W
an
g, “Fi
n
GP
T:
O
pen
-
s
ou
rc
e
f
i
nan
ci
a
l
l
a
rg
e
l
an
g
ua
g
e
m
ode
ls,” a
r
X
iv
p
r
ep
r
i
n
t
a
r
X
iv:2306.06031, 2023.
[
14
]
B. Z
han
g,
H
. Y
an
g,
and
X.
-
Y. Li
u
, “I
n
s
t
r
u
c
t
-
Fi
n
GP
T: Fi
nan
ci
a
l
s
en
t
im
en
t
ana
l
y
sis
b
y
i
n
s
t
r
u
c
t
i
on
t
un
i
n
g
o
f
g
ene
r
a
l
-
pu
r
po
s
e
l
a
rg
e
l
an
g
ua
g
e
m
ode
ls,” A
r
X
iv,
v
o
l.
ab
s/2306.12659, 2023.
[O
n
li
ne
]
.
A
v
a
il
ab
l
e
:
[
15
]
S. W
u
,
O
. Irs
o
y
, S. L
u
, V.
D
ab
r
a
v
o
ls
k
i, M.
D
r
ed
z
e
, S.
G
eh
rm
ann
,
P
. K
a
m
badu
r,
D
. R
o
s
enbe
rg,
and
G
. M
ann
, “Bl
oo
m
be
rg
GP
T: A
l
a
rg
e
l
an
g
ua
g
e
m
ode
l
f
o
r
f
i
nan
c
e
,” A
r
X
iv,
v
o
l.
ab
s/2303.17564,
2023.
[O
n
li
ne
]
. A
v
a
il
ab
l
e
:
[
16
]
I. L
o
s
h
c
h
il
o
v
and
F.
H
u
tt
e
r, “Fi
x
i
n
g w
e
ig
h
t
de
c
a
y
r
e
g
u
l
a
ri
z
a
t
i
on
i
n
A
da
m,” A
r
X
iv,
v
o
l.
ab
s/1711.05101, 2017.
[O
n
li
ne
]
. A
v
a
il
ab
l
e
:
[
17
]
T. L
ou
g
h
r
an
and
B. Mc
dona
l
d
, “W
hen
is
a
li
ab
ili
t
y
no
t
a
li
ab
ili
t
y
?
T
e
x
t
ua
l
ana
l
y
sis,
d
ic
t
i
ona
ri
e
s,
and
10
-
Ks,”
T
he
J
ou
r
n
al
of
Fi
n
a
n
c
e
,
v
o
l.
66,
pp
. 35 – 65, 02 2011.
[
18
]
P
. J. S
t
one
,
D
. C.
D
unph
y
, M. S. Smi
t
h
,
and
D
. M.
O
gil
v
i
e
,
T
he
G
ene
r
al
I
nqu
i
r
e
r
: A C
ompu
t
e
r
A
pp
r
o
ac
h
t
o
C
on
t
en
t
A
n
alysis. MIT
P
r
e
ss, 1966.
[
19
]
C.
H
u
tt
o
and
E.
G
il
be
r
t
, “VA
D
ER: A
pa
rsim
on
i
ou
s r
u
l
e
-
ba
s
ed
m
ode
l
f
o
r
s
en
t
im
en
t
ana
l
y
sis
o
f
s
o
ci
a
l m
ed
i
a
t
e
x
t
,”
v
o
l. 08,
no
. 01.
P
r
o
c
eed
i
n
gs
o
f
t
he
8
t
h
I
n
t
e
r
na
t
i
ona
l C
on
f
e
r
en
c
e
on
W
eb
l
o
gs
and
S
o
ci
a
l M
ed
i
a
, ICWSM
2014, 2015,
pp
. 216–225.
[
20
]
Z. T. K
e
, B. T. K
e
ll
y
,
and
D
. Xi
u
, “
P
r
ed
ic
t
i
n
g r
e
t
u
r
n
s wi
t
h
t
e
x
t
da
t
a
,”
N
a
t
i
ona
l B
u
r
eau
o
f
Ec
ono
mic R
e
s
ea
rc
h
, I
n
c,
N
BER W
o
r
k
i
n
g
P
ape
rs
26186, 2019.
[O
n
li
ne
]
. A
v
a
il
ab
l
e
:
[
21
]
J. B. B
e
r
k
and
P
. M.
D
e
M
a
r
z
o
, “C
o
r
po
r
a
t
e
f
i
nan
c
e
,”
v
o
l. 5, 2019.
[
22
]
Y
ahoo
Fi
nan
c
e
, “Tr
ea
s
u
r
y
y
i
e
l
d
10
y
ea
rs
h
is
t
o
ric
a
l
da
t
a
.” 2023.
[O
n
li
ne
]
. A
v
a
il
ab
l
e
:
VI. A
PP
E
N
D
IX
A. L
e
xic
on
-B
as
ed
A
pp
r
o
ac
he
s
1
)
H
a
r
va
r
d
I
V-
4
P
syc
ho
l
o
gical
D
ic
t
i
on
a
r
y
(
H
I
V-
4
)
:
H
IV
-
4
is
one
o
f
t
he
o
l
de
s
t
m
anua
ll
y
c
on
s
t
r
u
c
t
ed
l
e
x
ic
on
s,
and
is
u
s
ed
f
o
r
ob
j
e
c
t
i
v
e
l
y
i
den
t
i
fy
i
n
g s
pe
ci
f
i
ed
c
ha
r
a
c
t
e
ris
t
ics
o
f
m
e
ss
a
g
e
s i
n
a
r
ea
s i
n
v
o
l
v
i
n
g s
o
ci
a
l sci
en
c
e
,
po
li
t
ic
a
l sci
en
c
e
,
and
p
s
y
c
ho
l
o
g
y
. T
he
l
a
t
e
s
t
v
e
rsi
on
o
f
t
he
H
IV
-
4
d
ic
t
i
ona
r
y
c
on
t
a
i
n
s
o
v
e
r 11,000 w
o
r
d
s w
h
ic
h
a
r
e
cl
a
ssi
f
i
ed
i
n
t
o
one
o
r
m
o
r
e
o
f
183 c
a
t
e
g
o
ri
e
s. I
n
t
h
is w
o
r
k
, w
e
f
o
c
u
s
on
t
he
1,045
w
o
r
d
s l
abe
ll
ed
a
s
po
si
t
i
v
e
and
t
he
1,160 w
o
r
d
s l
abe
ll
ed
a
s
ne
g
a
t
i
v
e
.
2
)
L
ou
g
h
r
a
n
a
nd
Mc
D
on
al
d
(
LM
D
)
D
ic
t
i
on
a
r
y: L
ou
g
h
r
an
and
Mc
D
ona
l
d
e
v
a
l
ua
t
ed
s
t
anda
r
d
d
ic
t
i
ona
ri
e
s
and
f
ound
t
ha
t
t
he
s
e
f
r
equen
t
l
y
miscl
a
ssi
fy
t
e
rms wi
t
h
i
n
f
i
nan
ci
a
l
t
e
x
t
s. T
h
is
i
n
sig
h
t
l
ed
t
o
t
he
de
v
e
l
op
m
en
t
o
f
t
he
LM
D
d
ic
t
i
ona
r
y
, w
h
ic
h
is
s
pe
ci
f
ic
a
ll
y
t
a
il
o
r
ed
f
o
r
t
he
f
i
nan
ci
a
l s
e
c
t
o
r. T
he
d
ic
t
i
ona
r
y
c
a
t
e
g
o
ri
z
e
s w
o
r
d
s i
n
t
o
si
x
d
is
t
i
n
c
t
s
en
t
im
en
t
c
a
t
e
g
o
ri
e
s:
ne
g
a
t
i
v
e
,
po
si
t
i
v
e
,
un
c
e
r
t
a
i
n
t
y
, li
t
igi
ou
s, s
t
r
on
g m
oda
l,
and
w
ea
k
m
oda
l. I
t
w
a
s c
on
s
t
r
u
c
t
ed
u
si
n
g
da
t
a
f
r
o
m 50,115 10
-
K
f
ili
n
gs
f
r
o
m 8,341
f
irms lis
t
ed
on
t
he
N
e
w Y
o
r
k
S
t
o
c
k
E
x
c
han
g
e
(N
YSE
)
and
t
he
N
a
t
i
ona
l Ass
o
ci
a
t
i
on
o
f
S
e
c
u
ri
t
i
e
s
D
ea
l
e
rs A
u
t
o
m
a
t
ed
Q
uo
t
a
t
i
on
s
(N
AS
D
A
Q)
, c
o
v
e
ri
n
g
t
he
pe
ri
od
f
r
o
m 1994
t
o
2008.
Ov
e
r
a
ll,
t
he
LM
D
d
ic
t
i
ona
r
y
c
on
t
a
i
n
s 2,355
ne
g
a
t
i
v
e
f
i
nan
ci
a
l w
o
r
d
s
and
353
po
si
t
i
v
e
f
i
nan
ci
a
l w
o
r
d
s.
3
)
V
al
en
c
e
A
w
a
r
e
D
ic
t
i
on
a
r
y
fo
r
sE
n
t
i
men
t
R
e
as
on
i
n
g
(V
A
D
E
R)
:
V
A
D
ER c
o
m
b
i
ne
s l
e
x
ic
a
l
f
ea
t
u
r
e
s,
de
ri
v
ed
f
r
o
m
micr
o
-
b
l
o
g c
on
t
e
x
t
s, wi
t
h
t
he
gr
a
mm
a
t
ic
a
l
and
s
y
n
t
a
c
t
ic
a
l
c
on
v
en
t
i
on
s
t
ha
t
hu
m
an
s
t
y
p
ic
a
ll
y
e
m
p
l
o
y
t
o
e
x
p
r
e
ss
o
r
e
m
-
pha
si
z
e
s
en
t
im
en
t
i
n
t
en
si
t
y
. T
h
is
enab
l
e
s
V
A
D
ER
t
o
a
cc
u
r
a
t
e
l
y
quan
t
i
fy
t
he
s
en
t
im
en
t
s
t
r
en
g
t
h
o
f
t
e
x
t
. T
he
m
ode
l c
on
t
a
i
n
s
app
r
o
x
im
a
t
e
l
y
9,000
t
o
k
en
f
ea
t
u
r
e
s, w
h
ic
h
a
r
e
ea
c
h
a
ssig
ned
a
s
en
t
im
en
t
sc
o
r
e
r
an
gi
n
g
f
r
o
m
-
4
(
i
nd
ic
a
t
i
n
g
e
x
t
r
e
m
e
l
y
ne
g
a
t
i
v
e
s
en
t
im
en
t
)
t
o
+
4
(
i
nd
ic
a
t
i
n
g
e
x
t
r
e
m
e
l
y
po
si
t
i
v
e
s
en
t
im
en
t
)
. T
he
o
v
e
r
a
ll
po
l
a
ri
t
y
sc
o
r
e
f
o
r
a
t
e
x
t
is c
a
lc
u
l
a
t
ed
b
y
s
u
mmi
n
g
t
he
s
en
t
im
en
t
sc
o
r
e
s
o
f
ea
c
h
w
o
r
d
p
r
e
s
en
t
i
n
t
he
l
e
x
ic
on
, wi
t
h
t
he
f
i
na
l sc
o
r
e
no
rm
a
li
z
ed
t
o
f
a
ll wi
t
h
i
n
t
he
r
an
g
e
o
f
-
1
t
o
+
1.
B
.
D
eep
L
e
a
r
n
i
n
g A
pp
r
o
ac
he
s
1
)
Fi
n
B
E
RT
: Fi
n
BERT l
e
v
e
r
a
g
e
s
t
he
BERT m
ode
l
a
rc
h
i
t
e
c
-
t
u
r
e
,
and
is s
pe
ci
f
ic
a
ll
y
t
a
il
o
r
ed
f
o
r
f
i
nan
ci
a
l c
on
t
e
x
t
s. I
t
w
a
s
p
r
e
-
t
r
a
i
ned
on
a
s
ub
s
t
an
t
i
a
l
f
i
nan
ci
a
l
t
e
x
t
c
o
r
pu
s c
on
sis
t
i
n
g
o
f
1.8M
ne
ws
a
r
t
icl
e
s s
ou
rc
ed
f
r
o
m
t
he
T
ho
ms
on
R
eu
t
e
rs T
e
x
t
R
e
s
ea
rc
h
C
o
ll
e
c
t
i
on
(
TRC2
)
da
t
a
s
e
t
, s
pann
i
n
g
t
he
y
ea
rs
be
-
t
w
een
2008
t
o
2010. F
u
r
t
he
r r
ef
i
ne
m
en
t
w
a
s
a
c
h
i
e
v
ed
t
h
r
ou
g
h
f
i
ne
-
t
un
i
n
g
on
t
he
Fi
nan
ci
a
l
P
h
r
a
s
eban
k
(
F
P
B
)
da
t
a
s
e
t
,
t
hu
s
enhan
ci
n
g i
t
s c
apab
ili
t
i
e
s i
n
f
i
nan
ci
a
l s
en
t
im
en
t
cl
a
ssi
f
ic
a
t
i
on
.
Fi
n
BERT g
ene
r
a
t
e
s S
o
f
t
M
a
x
ou
t
pu
t
s
f
o
r
t
h
r
ee
l
abe
ls:
po
si
t
i
v
e
,
ne
g
a
t
i
v
e
,
and
neu
t
r
a
l.
6